Fast Online Reinforcement Learning Control Using State-Space Dimensionality Reduction
نویسندگان
چکیده
In this article, we propose a fast reinforcement learning (RL) control algorithm that enables online of large-scale networked dynamic systems. RL is an effective way designing model-free linear quadratic regulator (LQR) controllers for time-invariant (LTI) networks with unknown state-space models. However, when the network size large, conventional can result in unacceptably long times. The proposed approach to construct compressed state vector by projecting measured through projective matrix. This matrix constructed from measurements states it captures dominant controllable subspace open-loop model. Next, controller learned using reduced-dimensional instead original such resulting cost close optimal LQR cost. Numerical benefits as well cyber-physical implementation are verified illustrative examples including example wide-area IEEE 68-bus benchmark power system.
منابع مشابه
State Space Reduction For Hierarchical Reinforcement Learning
This paper provides new techniques for abstracting the state space of a Markov Decision Process (MDP). These techniques extend one of the recent minimization models, known as -reduction, to construct a partition space that has a smaller number of states than the original MDP. As a result, learning policies on the partition space should be faster than on the original state space. The technique p...
متن کاملCharacterization and Control of Hysteretic Dynamics Using Online Reinforcement Learning
Hysteretic dynamical systems are challenging to control due to their hard nonlinearity and difficulty in modeling. One type of systemwith hysteretic dynamics that is gaining use in aerospace systems is the shape-memory alloy-based actuator. These actuators provide aircraft and spacecraft systems with the ability to achieve component-level or vehicle-level geometry or shape changes. Characteriza...
متن کاملState-space Dimensionality Reduction in Markov Decision Processes
Learning of autonomous agents during their interaction with the environment is one of the frequent tasks in machine learning. However, the efficiency of the learning process drops dramatically with the complexity of the problem domain. In this paper, we present a survey of existing methods for reduction of the dimensionality. These methods can help find efficient solutions to the reinforcement ...
متن کاملMobile Agent Control in Intelligent Space using Reinforcement Learning
Finding the safest shortest path in an unknown environment is a fundamental task in mobile robotics. To emulate the human adaptibility in this field, we can use the Intelligent Space concept. The Intelligent Space is a distributed sensory system, which is the background infrastructure to observe human walking in a limited area. The observation of human beings is applied to create a walkable are...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Transactions on Control of Network Systems
سال: 2021
ISSN: ['2325-5870', '2372-2533']
DOI: https://doi.org/10.1109/tcns.2020.3027780